Graph Barlow Twins: A self-supervised representation learning framework for graphs

نویسندگان

چکیده

The self-supervised learning (SSL) paradigm is an essential exploration area, which tries to eliminate the need for expensive data labeling. Despite great success of SSL methods in computer vision and natural language processing, most them employ contrastive objectives that require negative samples, are hard define. This becomes even more challenging case graphs a bottleneck achieving robust representations. To overcome such limitations, we propose framework graph representation — Graph Barlow Twins, utilizes cross-correlation-based loss function instead samples. Moreover, it does not rely on non-symmetric neural network architectures contrast state-of-the-art method BGRL. We show our achieves as competitive results best fully supervised ones while requiring fewer hyperparameters substantially shorter computation time (ca. 30 times faster than BGRL).

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A Framework for Generalizing Graph-based Representation Learning Methods

Random walks are at the heart of many existing deep learning algorithms for graph data. However, such algorithms have many limitations that arise from the use of random walks, e.g., the features resulting from these methods are unable to transfer to new nodes and graphs as they are tied to node identity. In this work, we introduce the notion of attributed random walks which serves as a basis fo...

متن کامل

Generalized Optimization Framework for Graph-based Semi-supervised Learning

We develop a generalized optimization framework for graphbased semi-supervised learning. The framework gives as particular cases the Standard Laplacian, Normalized Laplacian and PageRank based methods. We have also provided new probabilistic interpretation based on random walks and characterized the limiting behaviour of the methods. The random walk based interpretation allows us to explain dif...

متن کامل

Graph-based Semi-Supervised Learning Framework for Medical Image Retrieval

As low level features can not reflect the high level semantic in medical image search, in this paper, we propose an image retrieval algorithm to combine visual concept and local features by graph-based semi-supervised learning framework. More specific, we construct a graph model by distance between images, and add density similarity measure in the label propagation progress to get the membershi...

متن کامل

Semi-supervised Data Representation via Affinity Graph Learning

We consider the general problem of utilizing both labeled and unlabeled data to improve data representation performance. A new semi-supervised learning framework is proposed by combing manifold regularization and data representation methods such as Non negative matrix factorization and sparse coding. We adopt unsupervised data representation methods as the learning machines because they do not ...

متن کامل

A Self-Supervised Framework for Clustering Ensemble

Clustering ensemble refers to combine a number of base clusterings for a particular data set into a consensus clustering solution. In this paper, we propose a novel self-supervised learning framework for clustering ensemble. Specifically, we treat the base clusterings as pseudo class labels and learn classifiers for each of them. By adding priors to the parameters of these classifiers, we captu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Knowledge Based Systems

سال: 2022

ISSN: ['1872-7409', '0950-7051']

DOI: https://doi.org/10.1016/j.knosys.2022.109631